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Abstract 



xs± ' Resource allocation in wireless networks typically occurs at PHY/MAC layers, while random 

O 

network coding (RNC) is a network layer strategy. An interesting question is how resource allocation 
mechanisms can be tuned to improve RNC performance. By means of a differential equation framework 
which models RNC throughput in terms of lower layer parameters, we propose a gradient based approach 
lyij ' that can dynamically allocate MAC and PHY layer resources with the goal of maximizing the minimum 

network coding throughput among all the destination nodes in a RNC multicast. We exemplify this 

CO ! 

general approach with two resource allocation problems: (i) power control to improve network coding 

CO ' 

throughput, and (ii) CSMA mean backoff delay control to improve network coding throughput. We 
design both centralized algorithms and online algorithms for power control and CSMA backoff control. 
Our evaluations, including numerically solving the differential equations in the centralized algorithm and 
an event-driven simulation for the online algorithm, show that such gradient based dynamic resource 
allocation yields significant throughput improvement of the destination nodes in RNC. Further, our 
numerical results reveal that network coding aware power control can regain the broadcast advantage 
of wireless transmissions to improve the throughput. 

Index Terms 

Resource allocation, differential equation framework, random network coding, power control, CSMA. 
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I. Introduction 

In wireless networks, resource allocation could take place at multiple layers of the protocol 
stack. Examples of these include transmit power control, channel allocation, and link scheduling 
at the PHY/MAC layer and buffer management at the transport layer. While network layering 
aims to reduce inter-layer dependency and brings noticeable benefits for interconnection, it is 
recognized that network performance can be optimized if network resources at different layers 
can be jointly taken into consideration for the design of network information flow. Specifically, 
the PHY and MAC layer resources, which tend to be isolated from upper layer functionalities, can 
be designed to support performance requirements at routing and transport layers [1J. The resource 
allocation problem has been extensively studied for different types of wireless networks (see flU- 
flU), such as cellular networks and wireless ad hoc networks. Nevertheless, the methodologies 
adopted in these works, for instance, maximum network utility, were built upon the premise 
that networks leverage traditional routing and forwarding. Therefore, when a different transport 
paradigm, such as random network coding (RNC), is employed, the traditional approaches fail 
to take full advantage of the distinct properties of RNC, and thus become less effective or even 
invalid. 

RNC allows the nodes in the network to perform coding of packets at the network layer. It has 
received a large amount of attention since its inception [5] and has been demonstrated to yield 
benefits in achieving the optimal network throughput A3, improving network security [0, and 
supporting distributed storage []Vl and content delivery [HO- Compared with the active progress 
in researching the benefits and application of RNC, there have been far less efforts looking 
into resource allocation for RNC. Existing ones include ll9l- [fTTi . In fact, due to the cooperative 
nature of RNC, varied allocation of resources at different nodes lead to complex interactions and 
unpredictable performance. We will elaborate on this complex interaction using two motivating 
examples: (i) power control in a wireless network with RNC, and (ii) CSMA backoff control in 
a wireless network with RNC. 

Let us first consider the effects of transmit powers on the performance of random network 
coding in the wireless network shown in Figured] The source node, node 1, is trying to multicast 
to a set of sink nodes, node {4,5,6}. In this network, every node is transmitting and is also 
able to receive from others. We further assume the network is interference limited, i.e., each 
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transmission is interfered by simultaneous transmissions from other nodes. Therefore, increasing 
transmit power at a node improves SINR value of its own transmission but raises interference 
to others. The throughput of the destination nodes thus depend on the power levels at all nodes. 
To observe this effect, we set the transmit power Pj x of each node % to 13dBm at t = Oms. 
Subsequently, at t = 500ms, t = 1000ms and t = 1500ms, the transmit powers of node 1,3,4, 
i.e., Pf x , Pj x and Pj x are increased to 14dBm, respectively. As seen in Figure |2] the power 
increment of node 1 at 500ms improves the throughput of all the sink nodes, whereas node 3's 
increment at 1000ms leads to the decrease of throughput of node 4 and 6. Therefore, increasing 
power at one node does not necessarily improve the throughput at all the destination nodes; on 
the contrary, it may possibly hurt the throughput at some node. 



Fig. 1. Hypergraph model of a wireless network of six nodes with s = 1 and T> = {4, 5, 6}. 

Now consider the case of adjusting the backoff time in a CSMA network employing RNC. 
We consider a network with the same topology as in Figure [T] that is utilizing CSMA as the 
MAC layer protocol. In this network, each node contends for transmission with an exponentially 
distributed delay value. We manipulate the mean of the backoff delay to control the transmission 
aggressiveness of each node and see its impacts on RNC throughput. At t = Oms, the mean 
backoff delay of each node is set such that all the destination nodes, node 4, 5, 6, are transmitting 
at about 0.12pkt/ms. Subsequently, at t = 1000ms, t = 2000ms and t = 3000ms, the mean 
backoff delay of nodes 1, 4, 6 are reduced, i.e., transmission aggressiveness increased, respectively 
as follows. The mean backoff delay of node 1 is reduced from 3.70ms to 2.24ms, node 4 from 
2.74ms to 1.66ms, and node 6 from 1.66ms to 0.83ms. Figure |3] shows that, for example, at 
t = 2000ms, when node 4 starts to contend more aggressively, it improves the throughput of 
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node 6. However, this simultaneously leads to the drop of the throughput of node 4 itself and 
node 5. An apparent reason is that it leads to reduced channel availability for these two nodes. 
Similar effects can also be seen for the subsequent window size change when node 6 becomes 
more aggressive. 



In 0.8 
E 

1/5 

CD 

o 0.6 

CO 

a 
•*-> 

1-0.4 

3 

o 



0.2 







/ 







A node 4 
□ node 5 
O node 6 ' 


i Q O — 






( 


) O Q 






! B B- 

L A A 


: Q Q 

— A A 


i 


i-B B - 






/ 


o c — ■ 

A A — 







Increase node l's power 



500 /1000 1500 
Time (milliseconds) 



2000 



Increase node 3's power 



Increase node 4's power 



Fig. 2. Effect of transmit power on network coding throughput. 

Both of the above two examples, one at the PHY layer, and the other at the MAC layer, show 
that due to the network dynamics and the complexity of the problem, it would be cumbersome 
or unsuccessful to employ some static, or heuristic resource allocation mechanism in a network 
employing RNC. Rather, a deliberately designed, and more importantly, dynamic resource alloca- 
tion algorithm is required to support the optimal RNC performance. Since RNC is fundamentally 
different from routing and forwarding in terms of packet delivery as there are no specific routes 
being computed and followed 021, analyzing it with traditional methods designed for uncoded 
networks will be problematic. To illustrate this, note that in a network where information is 
delivered based on some proactively determined route, network resources should be arranged 
such that certain network throughput can be achieved with certain reliability. However because 
of the nature of RNC, reliability is not a separate issue to be taken care of; resource allocation to 
improve network coding performance mainly is about improving throughput. Therefore, adopting 
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Fig. 3. Effect of CSMA backoff delay on network coding throughput. 



an inappropriate model will not take full advantage of the benefits that RNC offers. In light of 
this, a differential equation based framework in [fPI and [fl"4"l is of particular interest for deriving 
resource allocation algorithms for RNC. This framework leverages a system of differential 
equations to elegantly model the rank evolution process which shapes the RNC performance. 
The presence of PHY and MAC layer parameters in this model makes it natural to analyze lower 
layer resource allocation for RNC. 

In this paper, we address the problem of resource allocation for random network coding in 
wireless networks. In what follows, we first discuss the system model considered in this article 
and analyze RNC throughput with the differential equation framework in section lU Then in 
section Unl we formulate the resource allocation problem to maximize the minimum network 
throughput among the destination nodes. While this problem falls into the category of optimal 
control, which is usually solved by the method of calculus of variations, we present a gradient 
based algorithm specifically designed for this resource allocation problem here. Two use cases 
of this algorithm, i.e., power control and CSMA mean backoff delay control, are presented to 
improve network coding throughput in section [IV] and |V] respectively. Specifically, we derive 
both centralized and online algorithms for the above two use cases. The main contribution of 
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this work is to present a novel methodology to analyze cross-layer resource allocation in the 
context of RNC from a dynamical system view provided by the differential equation model. The 
framework utilized in this methodology is sufficiently general such that it can be used to analyze 
all kinds of PHY/MAC layer resources and derive effective resource allocation algorithms. 

II. Preliminaries 
A. Differential Equation Framework for RNC 

We adopt the directed hypergraph, introduced in [U~5l . to model a wireless network: G = 
(M,£) which has N nodes J\f = {1,2,...,N} and hyperarcs £ = E N,)C C M}. 

By introducing the hyperarc (i,JC), this model naturally captures the fact that in a wireless 
environment, a packet transmitted by node i can be received by a subset of nodes from K. To 
illustrate this, we note from Figure [Dthat each node has a point to point link to every other node, 
but a transmitted packet can only be received by a subset of these nodes. This subset could be 
determined explicitly by the received signal and interference levels (adopted in section [IV] for 
the case of power control), or implicitly by a thresholding distance for reception (adopted in 
section [V] for the case of CSMA). 

Consider that each node in the wireless network G is performing random network coding 
|fT2j. i.e., a source node sends out random linear combinations of the original packets (coded 
packets), and other nodes merely receive packets from the network and they in turn send out 
random linear combinations of the packets received. We assume each coded packet is a row 
vector of length I from W l q , where q is the field size. No routing operations are performed in the 
network and destination nodes can recover the original packets after collecting sufficient coded 
packets. Assuming packet loss is only due to bit errors, we can then define the probability that 
a packet transmitted by node i can be received by at least one node in JC, P^x. as 

Pi,K = i - n ( x - > w 

where Py is the reception probability of link We can see that P^ is a function of the 

PHY layer parameters, e.g., transmit powers and interference. Assuming there exists certain 
MAC protocol running in its stable state such that node i is sending out coded packets at the 
average rate of \ packets per second, then the successful transmission rate from node i to node 
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j can be defined as 

Zi,K — \Pi,K- (2) 

Zi x, can also be regarded as the capacity of hyperarc (i,lC). Note that the capacity of a cut, T 
for (<S, K), S,K. <Z N where /C C T C <S C is given as c(T) = X]ier c Z *>T- Then, the min cut 
for (S, K) is the cut with the minimum size. We call the number of linearly independent coded 
packets the rank, and use Vu\ to denote the rank at node i. We define an innovative packet of 
node i as the received packet which increases the rank V^y. For a RNC multicast session, if there 
are m original packets to be delivered, each destination node i can decode only if Vu\ = m. 
The notion of rank can be naturally extended to a set of nodes, /C, and thus V/c is the joint 
rank of all the nodes from /C. We call the stochastic process V)c(t) that grows from to m 
the rank evolution process. In lTT3Tl . it has been established that under the fluid approximation, 
we have a concentration result for the rank evolution process, i.e., the stochastic process V/c(t) 
is well represented by its mean, E[V;c(t)]. Also, the following system of differential equations 
have been derived to model the rank evolution process Vjc(t): 

Vk = J2 - Q VK ~ V{i}UK ), V/C C M and K ± 0. (3) 

ifJC 

It is worth noting that V/c is the rate at which /C is receiving innovative packets, i.e., V K denotes 
the throughput of K,. Apparently, with z^x, being an abstraction of the outcome of all the 
PHY/MAC operations in the system of differential equations ([3]), the throughput of a set of nodes 
can be elegantly analyzed with respect to PHY/MAC parameters. To illustrate this, we present 



two numerical examples. First consider a wireless network shown in Figure |4(a)1 (also discussed 
in lfT3lO where the source node, node 1 intends to multicast 1000 packets to destination nodes 
2,3,4. Let each node perform RNC operations and transmit at lpkt/ms. Suppose that packets 
from node 1 can only be successfully received by node 2 and 3, with probability of 0.2 and 0.4, 
respectively, and node 2 and node 3's packets can only be successfully received by node 4 with 
probability of 0.6 and 0.7, respectively. Based on the above parameters, we can compute the 
successful transmission rate Zijc for each hyperarc (i,K) for this topology. Then all the z^jc are 
plugged in the system of differential equations ® and solving them yields the result shown in 
Figure |4(b)| the plot of rank evolution process for this RNC multicast. It can be easily verified 
that the throughputs of the destinations, i.e., the rates at which ranks increase, match the min 



s 




cuts of every source and destination pair. For instance, it is trivial to see the min cut between 
node 1 and 2 is 0.2, which is equal to the slope of the straight line for V2 in Figure [4(b)] Next, 
we present an example with a larger topology. Consider the eight-node wireless network shown 



in Figure |5(a)| Each line connecting two nodes denotes a bidirectional communication link with 
the packets reception probability next to the line. This time node 1 has 1000 packets to deliver 
to node 3, 5 and 8. We still let each node transmit at lpkt/ms. The result of solving equations 
© for rank evolution is shown in Figure |5(b)| Again, the system of DEs serve as an accurate 
analytical model of RNC throughput. The throughputs implied by Figure [5(b)] i.e., throughputs 
of nodes 3,5 and 8 being 0.4pkt/ms, 0.2pkt/ms, and 0.4pkt/ms, respectively, match the values 
of min cuts highlighted by the dashed curves in Figure |5(a)[ Thus the DE framework in |[T3l is 
versatile and can be used to study the dynamics of RNC in any arbitrary network. In this paper, 
we will develop a dynamic radio resource management methodology using this framework. 

III. Resource Allocation Algorithm 
for Wireless Network Coding 

A. Problem Formulation 

Consider a wireless network G = (J\f, S) which is performing random network coding. The 
source node s tries to multicast m packets to a set of sink nodes. We proceed to consider 
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(a) 8-node network topology (b) Rank evolution 

Fig. 5. Rank evolution modeled by DE, example 2. 



some PHY or MAC layer resource at every node i and denote it as fj. Note that r» can be any 
PHY/MAC layer parameter which contributes to the transmission rate Aj or the packet reception 
probability P^k- Letting the vector r denote [ri, r 2 , rjy] T , we have 

Zi,K = Zijc{r), (4) 

i.e., the reception rate z^jc for each hyperarc (i, /C) is an explicit function of allocated resource 
r. To formulate the resource allocation as an optimization problem for improving the RNC 
performance, we consider maximizing the minimum throughput among all the sink nodes as the 
objective function. We let 1Z be the set of destination nodes which have not reached full rank, 
m. With a little abuse of notation, we let Vu\ denote V^. Then letting k = argmin jG 7^ Vj, we 
construct an optimization problem to maximize Vk as follows: 

maximize 

subject to Vjc = z itl c ■ (1 - q v ^~ v {^), V/C c M. 

k = arg min V« 
variables r. 
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B. Gradient-based Resource Allocation Algorithm 

Note that in general, the optimization problem given by © is not convex, and thus it is 
difficult to find the optimal solution efficiently. Additionally, this type of problem which is 
constrained by a set of first-order differential equations can be categorized into an optimal 
control problem. Existing approaches to optimal control involve calculus of variations, which 
can be computationally expensive and intractable in wireless networks. In this paper, we aim to 
find a local optimum of this problem which can provide significant throughput gains with less 
computational complexity. We take an approach based on the steepest ascent (its counterpart for 
minimization problems is called steepest descent, see [QUI), i.e. adjust the resource r towards the 
direction of the gradient. Essentially, our optimization objective, V k is a function of the resource 
r, i.e., Vk = Vfc(r). This allows us to establish the gradient of throughput as the direction of the 
dynamic adjustment of the resource, i.e., 

r = a' ■ VT4, (6) 

where a' is a positive constant tuning the gain. In this way, the allocation of resource will be 

iterative, as well as dynamic. We consider a discrete approximation to compute the derivative 

in equation © as follows. Let Av be the step size, and be a column vector with 1 being the 

ith component and elsewhere. Writing in component-wise form, we have 

, V k {T + Avei)-V k (T) 

ri = a . (7) 

Av 

Replacing a' / Av with a, we have: 

n = a- (y k {v + Avei) - \4(r)) . (8) 

Equation ([8]) serves as the basis of the resource allocation algorithm and works in an iterative 
manner to adapt the resource allocation towards the direction of the gradient of the minimum 
throughput. In the above, V k is given by equation © and thus the allocation of resources 
takes into consideration the latest network throughput information and therefore also works 
in a dynamic fashion. 

Note that until now, we have not imposed any specific models for the PHY/MAC layers. 
In fact, the resource allocation approach presented here is flexible enough that it can work 
with any specific lower layer models/mechanisms. For a better elucidation of this approach, 
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we illustrate its applicability by solving two practical allocation problems for RNC: (i) power 
control for maximizing the minimum throughput, and (ii) CSMA mean backoff delay control 
for maximizing the minimum throughput. In what follows, we present the particular PHY/MAC 
layer models considered for the exemplary problems and derive the corresponding algorithms. 

IV. Dynamic Power Control in RNC 

There exists a rich history of transmit power control for cellular networks (see El) where 
the goal was to minimize the total power levels [[T8l - ll20l . or to maximize network utilities 
[[2T | - ll23l . In this section, however, we consider performing power control in a coded wireless 
network to improve RNC throughput. 

A. Interference Model 

While the gradient based resource allocation framework in section [III] is applicable for any 
wireless network with RNC, in this section we will specifically illustrate its use for power control 
in a network where we model the interference as Gaussian. In this section, we assume the wireless 
network G to be interference limited, and model each point-to-point link gain hji for with 
a path loss model. We use Pj x to denote the transmit power at node i. The received signal level 
is given by Pj^hji. Each node i is assumed to implement a certain processing gain gi. Therefore, 
when node j intends to receive the signal transmitted by i, the aggregated interference power is 

Let cr 2 denote the noise power. The signal-to-noise-and-interference ratio (SINR) for the point- 
to-point link can be written as 

SINR {i>j) = . (10) 

Jji + a 2 

Assuming BPSK signaling and Gaussian interference, the bit error rate for sender-receiver 
pair is given as 

^ = Q (^SINR^) . (11) 

Further, assuming each packet is of I bits, the probability that node j can receive a packet 
without error is 
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Note that the differential equation framework requires the computation of P^jc given in 
equation (OQ). Under the above interference model, we assume that there is a MAC protocol 
running in steady state such that each node i has an average transmission rate A*. Therefore, 
Zijc in equation © can be now written as: 

= a. • (i - rw (i - (i - q (^iwfe^y)) • <i3) 

B. Centralized Power Control 

Let P Tx = \Pj x , -Pj x , -P/y x ] T be the transmit power vector and the resource rj = Pj x . The 
centralized power control algorithm follows directly from equation © (see also Il24l and IfTTlO : 

f? x = a • (\4(P Tx + Ave t ) - \4(P Tx )) , (14) 

where 

based on the interference model above. 



We assume there is a certain power budget at each node i, i.e., < Pj x < Pj max . Considering 
this, the algorithm can be summarized as: 



k = arg 


mm jen Vj 








o, 


if (P^ = 


P™ x and \4(P Tx + Avei) > \4(P Tx )) 


P?= < 




or (i^ Tx = 


and \4(P Tx + A^e,) < \4(P Tx )); 




a-[14(P Tx + A^)-T4(P Tx )], 

V 


otherwise. 





To compute the throughput gradient for node i, the above algorithm requires the knowledge of 
\4(P Tx + At>ej), the throughput of node k when only node i's power is incremented and other 
nodes' powers remain unchanged. This is only possible when there is a central controller which 
has the global knowledge of the whole network, especially the PHY layer specifics, such that 
Zik can be obtained for all i, and further, the central controller needs to compute the power 
adjustment for each node. Therefore, we call it a centralized resource allocation algorithm. This 
algorithm serves as a theoretical basis for the gradient algorithm considered here, but is difficult 
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to be practically implemented to operate online, as it assumes the knowledge of PHY layer 
specifics all the time. 

C. Online Power Control 

While the algorithm in section HV-B I is effective in achieving the objective to improve network 
coding throughput ifTTl . it can be further improved for the purpose of implementation. Specifi- 
cally, it would be more desirable if the algorithm can operate online, i.e., each node computes 
the gradient for itself and adjusts its power without any noticeable delay. 

We begin by discretizing the algorithm from IIV-B1 i.e., we divide the time into equal-length 
intervals, and seek an online algorithm which estimates the gradient at each interval, and adjusts 
powers at the end of each interval based on the most recent estimates. Let T denote the objective 
function in equation ©, i.e., T = min jG7 ^V^ and VpTzT denote the gradient of T. The online 
algorithm is now given as: 

P Tx (n) = P Tx (n-l) + a- VpTxT(n-l), n = 2,3,4,... (17) 

where a is the gain parameter for power control, and P Tx (ra) and T{n) are P Tx and T in the 
nth interval, respectively. Note that the gist of the online algorithm lies in the estimation of 
VpTxT(n — 1) at each node based on the network information available to it, which is described 
in the following. We first introduce the following notations: 

• Let V denote the size- (2^ — 1) throughput vector, consisting of Vjc, V7C C N, K, ^ 0. More 
precisely, V is given by 



V 



^{1} V{2} V{1,2} V{3} ■■■ V{1,2,...,7V} 



(18) 



• Let z denote the size-(iV ■ (2^ — 1)) packet reception rate vector, consisting of z^rc, Vi € 
M, K, C N, K, ^ 0. For each i, z^jc, V/C C M is arranged similarly with V. Then z is given 
by concatenating z^x,, V/C C Af, /C ^ from % = 1 to % = N: 

Z = [Zl,{l} z l,{2} Zl,{l,2} ••• Zl,{l,2,...,N} ■■■ 2JV,{1,2,...,JV}] (19) 

• Let z' iK denote the innovative packet reception rate of hyperarc (i,/C). 

• Let z' denote the size-(A^ • (2^ — 1)) innovative packet reception rate vector, consisting of 
z' iK ,V(i,)C) E £. By replacing every of z with z' iK , we get z'. 
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Note that T is a function of V, i.e., T = T(V). We remark that the online algorithm we 
are deriving can accommodate any optimization objective as long as T remains a differentiable 
function of V IfTTTl . Here we use the minimum destination throughput as an example to derive the 
algorithm, i.e., T = Vk, where k = aigminj^Vj. Since we have V = V(z) and z = z(P Tx ), 
then based on the chain rule, gradient of T with respect to transmit powers P Tx can be derived 
as: 

VpxxT = VvTJ z VJ P TxZ, (20) 

where V^T, J Z V, and Jp T z are the gradient of T with respect to V, the Jacobian of V with 
respect to z, and the Jacobian of z with respect to P Tx , respectively. Equation (|20l provides the 
exact formula for computing the gradient of T. To derive the online algorithm, we shall first 
investigate the first two terms together and then the last term on the right hand side. Since we 
have T = V k , we can get 

V V TJ Z V = V Z T = V Z T4. (21) 

Referring to equation (fT9l) . and noting V k = J2i0 z i,k ' (1 — g v * _v i i ' fc }), we have 

V z 14 = [0,1 - q Vk - y ^ k \l - g Vfc - y ( 2 - fc >,0, ...,0, 1 - q Vk - v i k -^y,0, ...,0, 1 - g^-W,^ ...] . 

(22) 

Noting V z Vfc has (N — 1) non-zero components: 1 — 5 V * -V t». fc }, Vi G Af,i ^ k, we would like 
to avoid evaluating V z Vfe since it requires the knowledge of V^y, the joint rank of node i 
and k. Instead, note that z iX is defined as the packet reception rate, and (1 — g^-^^uc) is the 
probability that the received packet is an innovative packet. Then the innovative packet reception 
rate z' iK is given by z' iK = z^x • (1 — (^"^wuk) _ Therefore, we take an alternative approach to 
consider the derivative with respect to the innovative packet reception rate z' instead of z. With 
z', we can rewrite equation © in a more compact form: 

and V z 'Vfc can be derived accordingly as: 

V z iV k = V V T • J Z ,V = [0, 1, 1, 0, .., 0, 1, 0, .., 0, 1, 0, ... 0]. (24) 
Then the gradient of T can be calculated by 

V pTx T = VvTJ z ,VJ p txz'. (25) 



15 



Thus the evaluation of equation (|25l ) boils down to the evaluation of J p txz'. Note we would 
avoid the approach of directly evaluating it as this would again require that the underlying PHY 
layer specifics of all the nodes be known universally. Furthermore, computing the Jacobian, 
i.e., JpTxz' can be computationally prohibitive. Rather, we numerically estimate this Jacobian 
at each iteration by following a similar approach that is adopted in Broyden's method [|25l . 
For that purpose, we need to discretize the current algorithm which uses a continuous time 
model for network coding. We thus consider the time divided into equal-length time intervals 
(corresponding to the time between successive power updates) and assume that each interval is 
of r seconds. Then according to ll25l . we have 



T it \ r u *s Az'(n) — JpTxz'(n — l)AP Tx (n) T T 
J pTx z'(n) = J pTxZ '(n - l) + ^ ||AP^(n)|| 2 — AP TxT (n), (26) 

where Az'(n) = z'(n) - z'(n - l) and AP Tx (n) = P Tx (n) - P Tx (n - l). 

We can estimate the average innovative packets reception rate in each time interval which is 
of length r, i.e., 

z i,j( n ) = C i,j( n )/ T i ( 27 ) 

where Cjj(n) is the number of innovative packets sent by node i that node j has received in 
the nth time interval. Note that the granularity of power updates are based on this time interval. 
Now with the time being discretized, we can rewrite equation (|25l) to give the gradient in the 
nth interval: 

VpxxT(n) = VvT(n)J z ,V(n)J P xxZ / (n). (28) 

Note to initiate the algorithm, we need to provide an initial estimate of J p txz', i.e., J p txz'(0) 
and randomly generate the first power update. To detect the convergence of the online algorithm, 
a threshold value, which can be an achievable and satisfactory throughput value, should be set. In 
any interval i, the numerical value of T(i) is monitored and if it grows larger than the threshold, 
the algorithm will maintain the previous allocation; otherwise, the gradient will be estimated 
and power at each node will be adjusted. Moreover, to refrain from unduly large gradient update 
which might lead the algorithm to an unstable state, we observe the results given by (1281) and if 
the gradient is larger than a threshold s, we normalize the gradient, i.e., 

. „I"^"!'! z/ S n w pTxZ !S n ? li ; if V v T(n)J z ,V(n) JpTxz'(n) > s 

VpTxT(n) = { HVv^(«)^V(n)J pTx z'(n)|| ' V V J z V J P V J - ^ 

VyT(n) J x i V (n) JpTx z' (n) , otherwise. 
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Finally, the transmit powers are adapted according to the following equation 

P Tx (n) = P Tx (n - 1) + a ■ V P TxT(n - 1), (30) 
where a is the gain parameter for power control. We summarize this algorithm in Algorithm [T] 

D. Numerical Results 

We use two ways to evaluate the power control algorithm for random network coding: for the 
centralized algorithm, we use a numerical differential equation solver to compute the throughput; 
and for the online algorithm, we implement the algorithm with an event-driven simulation. 

For the evaluations, we consider the topology of a 6-node network as shown in Figure [Q This 
network is assumed to be running random network coding, i.e., original packets are being coded 
at each node, and the intended destination nodes decode to recover them. Therefore, the original 
packets are not "routed" towards the destination nodes. The goal is for a sender node, node 1, to 
multicast 2000 packets to a set of sink nodes, node 4, 5, 6. We assume there is a path loss model 
for each point to point link in this network. We use the ITU model for indoor propagation [26], 
where the path loss of the transmission from node i to node j, PLjj is given by: 

PLji = 20 log / + lOn log dji + P f {n) - 28. (31) 

In this evaluation, the transmitted signal frequency / is set to be 2.4GHz, path loss exponent n to 
be 3, and floor penetration factor Pf(ri) to be 11. Thus the link gain for can be computed 

as hji = 10 PL ^ 10 . 

1) Centralized algorithm: Figure |6] shows the results of throughput and power adjustment of 



the centralized power control algorithm. In Figure |6(a)j we can see that without power control, 
the throughputs of the three destination nodes, node 4, 5, 6 are all less than 0.5pkt/ms, and the 
minimum of them is less than 0.25pkt/ms. With dynamic power control, the throughput of all 
the nodes is improved. From around t = 400ms, the throughputs begin to converge to the same 
value, lpkt/ms. Since each node, including the source node, has a transmission rate of lpkt/ms, 
the optimal multicast throughput is also lpkt/ms and the centralized algorithm achieves this 
optimum, thereby showing that this network coding aware power control regains the broadcast 
advantage. From Figure |6(b)| we can see that the transmit power at each node is continuously 
adjusted by the power control algorithm. When the algorithm is started, i.e., t = 0ms, powers 
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Algorithm 1 Online network coding aware power control algorithm 
r <- Power update granularity 

T <- Time interval to make gradient computation 

rand(N,l) <- length- N random vector with each element larger than —0.5 and less than 0.5 
c(0) <— 0: counters for number of innovative packets. 
P Tx (0) <- P init 

JpTxZ'(O) -f- JpTxZ /mlt 

while t < t do 

update c(0) 
end while 

compute z'(0) 

P Tx (l) = P Tx (0) + rand(iV, 1) 
n 4- 1 

while nr < t < (n + l)r do 
update c(n) 

if t > (n + l)r — r then 

while VpTx T{n) has not been computed do 
compute z'(n) 

AP Tx (n) = P Tx (n) - P Tx (n - 1) 
Az'(n) = z'(n) - z'(n - 1) 
Compute JpTxz'(n) as in (|26|) 
Compute gradient VpTxT(n) 
Set power P Tx (n + 1) = P Tx (n) + a ■ V P TxT(n) 
n n + 1 
end while 
end if 
end while 
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(a) Effect of power control on throughput 
Fig. 6. Centralized power control (a) Throughput, (b) power adjustment. 
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of node 1,2,5 are increased, on the other hand, other nodes' power are suppressed. When 
approaching throughput convergence, the algorithm sets the powers of nodes 1,2,5 to about 
15dBm, and all the other nodes' powers to less than 12dBm. 

We also compare the dynamic power control algorithm with a benchmark algorithm. In the 
benchmark algorithm, we formulate the max-min throughput problem for RNC based on the 
model of network flows []27l . For each destination d G 1Z, there is a flow f d associated with 
it. To make the interference tractable with the network flow model, we consider specifically 
that this network uses TDMA for media access control and assume unicast communication. We 
further assume that each node i uses the same power for transmissions on all its outgoing links. 
Let tij denote the time fraction that node i allocates to link and E denote the set of all 
the point-to-point links. Let W{ be the throughput of node i, be the neighbor nodes of node 
i which can transmit to or receive from node i. A, = 1 is the rate that node i is transmitting. 
Then an equivalent formulation of the max-min throughput problem described in equation © 
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with respect to power control is given for the network flow model as follows: 



maximize W (32) 

subject to W < W d , d e K (33) 

W' = E & - E (3 4 ) 

= °.*^m (35) 

< < t itjZiJ (36) 

E *vi < 1 ^ 37 ^ 

kj > (38) 



^ v H(iSw^I <39) 

variables t iJ} (i, j) eE,deTZ 

P Tx , W. 

In equation d39l) . /ij, is the link gain and <fc is the processing gain. Note that the above (benchmark) 
formulation is a straightforward extension of the linear programming formulation of network 
coding (see [28]) since the objective function, i.e., equation (132b . and the constraints (|33b -(l36b 
are equivalent to it. Feeding this formulation with the same topology and initial conditions as 
that are used in the dynamic power control simulation, a numerical nonlinear program solver 
yields the optimal value of lpkt/ms with Sequential Quadratic Programming (SQP) method ||2~9l . 
However, note that this algorithm can only be applied in a static fashion, i.e., it does not retain 
the dynamic characteristics of the power control in equation (fl4)) . Without taking into account 
the dynamic growth of ranks in RNC, any changes in the network would render a previously 
optimal allocation unsatisfactory and to make it work, a new allocation has to be computed. 

2) Online algorithm: In the simulation for online power control, the power is adjusted in 
every discrete time interval. Here, the interval is set to 150ms. The power levels of all the nodes 
are set to 13dBm in the first interval, and a random update is applied in the second interval. 
After this initialization, in any interval n, we attempt to maintain a fixed step size 7 with the 
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(a) Effect of power control on throughput 
Fig. 7. Online power control (a) Throughput, (b) power adjustment. 
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following rule: 

' pTx(n-l)+ T) if a .?gg>7 



Pj x (n) 



J**(n-l)- 7l if fl .^<- 7 (40) 
Pj x {n— 1), otherwise. 
In this simulation, we set 7 as 0.2dBm. From Figure |7(a)| we can see in the first interval of this 
experiment, the destination nodes' largest throughput is about 0.5pkt/ms, and the throughputs of 
node 4 and 5 are both less than 0.3pkt/ms. As the algorithm progresses, the minimum throughput 
increases from about O.lpkt/ms to about lpkt/ms, and approaches convergence of about lpkt/ms 
around t = 1500ms. Figure |7(b)| shows how the transmit powers at each node are adjusted by 
the online power control algorithm. 

V. Dynamic CSMA Mean Backoff Delay Control in RNC 

We now consider another resource allocation problem for RNC at the MAC layer, namely, 
CSMA mean backoff delay control. There exist a number of algorithms for maximizing CSMA 
throughput by link scheduling in a multihop network, as can be found in 11301 - 113211 . However, 
these algorithms do not consider or make use of the broadcast effect of wireless transmissions 
as RNC does. When CSMA is the underlying wireless media access control mechanism of a 
coded packet network, we perform dynamic CSMA backoff time control to optimize network 
coding performance, taking into account that each transmission is intrinsically a broadcast and 
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neighbors will receive the transmitted packet. Although the general algorithm presented in section 
Hill is sufficiently flexible such that it does not need to assume any particular model for Aj, 
we now introduce a CSMA model for the purpose of illustration. We then apply the resource 
allocation algorithm in this setting to dynamically adjust the mean of backoff delay at each node 
to maximize the minimum throughput among the sink nodes. Note that the differential equation 
framework in equation © described earlier requires the knowledge of Zijc, the rate at which the 
packets from i are successfully received by at least one node in /C. We will now derive z^jc for 
this CSMA model. 

A. CSMA Model 

The CSMA model considered here was first introduced in [33] and is illustrative of a multihop 
network as is the case for RNC. We consider the wireless network G = (Af, S) and let iVj denote 
the neighbors of node i, i.e., all the nodes that are within the range to be able to communicate 
with node i and N* — TVjU {i}. It should be noted that we assume here that the layer of network 
coding operation sits above the MAC layer on the protocol stack, and in this section, we refer 
to packet as the coded packet with the MAC header attached. We describe next the assumptions 
for the CSMA model from 051 : 

• When a packet is scheduled to be transmitted at node i, the node senses the channel 
first. If the channel is idle, i.e., no ongoing transmissions from node i transmits the 
packet immediately. We assume that the packet length is exponentially distributed with 
instantaneous transmission (zero propagation delay). We use 1/yU,, to denote the mean of 
node z's packet length. 

• After sensing the channel, if the channel is busy, node i defers its transmission according 
to a random delay. The scheduling of packets, including the deferred ones, together with 
the newly scheduled after a successful transmission, is a Poisson process with rate aj. 

• Any node from iVj, which are not currently receiving, can receive the packet from node i 
without error immediately after the transmission. Subsequent transmissions heard by node 
i while it is receiving will fail. 

Let x l , i — 0, 1, M be a length- N vector denoting the valid transmission status of the whole 
network where the jth component of x\ Xj, is 1 if node j is transmitting, and otherwise. For 
instance, [1 1 0] implies node 1 and node 4 are transmitting and other nodes are idle, and 



22 



it is only valid when node 1 and 4 are not neighbors of each other. Let G(x l ) denote the set of 
transmitting nodes in state x l and H(x l ) denote the set of nodes that are not neighbors of any 
node in G(x l ). The state transitions among all the states x % constitute a finite-state continuous 
Markov chain. Let Q(x l ) be the stationary probability of state x\ we have the following global 
balance equations: 

EjeG(sc<) Q(x l )fij + J2jeH(x>) Q{% l ) a j 

= EieG(x«) Q( xi ~ e Mj + Ejeff(x') Q( xi + e i)/ i i' * = X > -> M > 
where is a length-iV vector where the jth component is 1 and O's elsewhere. It can be verified 
that the following detailed balance equations hold: 

Q(x i + e j )fi j = Q(x i )a j , i = 0, 1, M, j G H{x i ). (42) 

Let x° denote the state that no nodes are transmitting, and define Vj = aj/fij. Then 

Q(x*) = Q(x°) J] Vj , i = l,...,M, (43) 

and 

q(x°)=i/(J2 n ^ 

Note that for a packet scheduled by node i to be received by one of its neighbor nodes, j, 
the following requirements must be satisfied: 

• i must be idle. 

• All the neighbors of i, including j, must be idle. 

• All the neighbors of j must be idle. 

Based on the above results from [33], we can now proceed to derive the probability that a packet 
scheduled by node % can be received by a neighbor node j and let P/ • denote this probability. 
One should distinguish P[- from Pj j, since P i: j is the conditional probability that a packet 
transmitted by node z can be received by node j. Let I(X) denote the event that all the nodes 
from the set X are idle. Then 

Pij = Prob[/(iV:* U N*)} = Yl ( 45 > 

G(x m )cN\(N*UN*) 
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Further, we continue to derive P' ilc , the probability that a scheduled packet from i can be received 
by at least one node in /C. Let K' — K n N if then 

3.4C/C', s.t. G(x m )cA r \(AT*UAf^) 

where = Ujg^iV*. Then, the rate at which node z's packets are successfully received by at 
least one node from set /C is given by: 

Zi,K = OiPljc- ( 47 ) 
While the above developments assumed that packet length is exponentially distributed, it turns 
out that this assumption can be relaxed. For instance, it has been shown in ll34l that the results 
derived using the above model are more sensitive to the mean /ij, rather than the distribution 
itself. Therefore, the expressions in equations (l46l and (|47T) are suitable for analyzing CSMA in 
a RNC network where transmitted data packets at the network layer are assumed to be of the 
same length. 

B. Centralized Gradient Algorithm for CSMA Mean Backoff Delay Control 

In a CSMA network, we consider the network resource r to be the rate of the Poisson 
scheduling process, a, i.e., r = a. Since a Poisson process has exponentially distributed arrival 
times, the backoff delay of node % will be exponential with mean l/a*. Our goal is to adjust a 
to maximize the minimum throughput. Thus, as long as we have the formulation of the CSMA 
model above, we know that the reception rate z^jc is a function of a, i.e., 

Zi,K = Zi,tc(oc). (48) 

Let node k be the node with the minimum throughput among all the destination nodes, i.e., 
k = argminjg-R. Vj. Then based on the system of equations ©, we have: 

= EieN k «i " (Eo^cVXWuns) Q^ m )) ■ (! " q Vk - V ^) (49) 

= SigiV fc a i ' (j2G(x™)cAf\{N*UN*) Q( x °) YljeG{x m ) a j/l 1 j^ ' (1 — 1^ V{l ' k} )- 

The versatility of the aforementioned dynamic resource allocation algorithm allows us to derive 
an algorithm customized for the CSMA backoff delay control problem. To this end, we follow 
equation ([8]) and get 

an = a ■ (V k (a + Ave,) - V k (aj) , (50) 
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where a is the control gain value, Av is the step size, and is a vector whose ith component 
is 1 with elsewhere. 

C. Online Gradient Algorithm for CSMA Mean Backoff Delay Control 

We can also derive an online version of the resource allocation algorithm for CSMA mean 
backoff delay control based on the centralized gradient algorithm. As in the case of dynamic 
power control, the online algorithm for CSMA backoff control at each node makes the estimation 
of the gradient without any knowledge of the underlying PHY/MAC layer specifics at other nodes, 
and iteratively adjusts the value of the mean backoff delay a: 

a(n) = a(n- 1) + a ■ V a T(n- 1), (51) 

where a(n) is a at the nth time interval. Note that the gradient to be approximated is V a T(n). 
We can utilize a similar derivation as for the case of power control which results in: 

V a T{n) = V v THJ z ,V(n)J a z'(n), (52) 

where J a z' is the Jacobian of z' with respect to a. 

To reduce the computational overhead, we can still follow Broyden's method G51 to estimate 

J a z'(n) 

J a z'(n) = J a z'(n-l) + 1 ; ,| A Q ; , M2 ; — Aa n . (53) 

|| Aa(n) \\ z 

D. Numerical Results 

We perform two kinds of evaluations: (i) a differential equation solver based evaluation for 
centralized CSMA mean backoff delay control and (ii) an event-driven simulation for the online 
algorithm. We use the 6-node network shown in Figure [T] and consider that each node has 
a set of neighbor nodes, as summarized in Table H The neighbors are determined based on 
a thresholding distance between nodes. Recall that «j is the scheduling rate of node i. We 
measure this rate in packets per millisecond (pkt/ms). In both evaluations, we introduce a scalar 
parameter taking the value of log a,. We call the transmission aggressiveness of node i 
and set 3 < 0i < 6.5, i = 1,2, ...,N. Initially, of every node i is set to 4 and therefore the 
average scheduling rate is about 0.06pkt/ms. We assume the packets are of fixed length and 
set 1/ Hi of any node i to be l/1000ms. 
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Node 


rNClgllUUIa 


i 




2 




3 


{1,4,5} 


4 


{3,5,6} 


5 


{1,2,3,4,6} 


6 


{2,4,5} 



TABLE I 
Nodes and their neighbors. 
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Fig. 8. Centralized contention window size control (a) Throughput, (b) contention window size adjustment. 



1) Centralized algorithm: The results of DE solver based evaluation for centralized CSMA 
mean backoff delay control is shown in Figure [8] The dashed lines in Figure |8(a)| indicate that 
without dynamic backoff control, the throughput of nodes 4, 5, 6 remain at about 0.06pkt/ms. 
The resource allocation algorithm increases all the three destination nodes' performance and 
their throughputs converge to about 0.22pkt/ms, making it a gain of greater than 200% from the 
initial throughputs. Figure |8(b)| shows how the transmission aggressiveness (3 is continuously 
adjusted at each node. 

2) Online algorithm: From Figure |9(a)| we can see that all the three destinations' original 
throughputs are less than 0.075pkt/ms at t = 0ms. Starting from t = 1ms, the online resource 
allocation algorithm gradually improves the throughputs of all the destination nodes. Around 
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(a) Effect of contention window size control on throughput 
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Fig. 9. Online contention window size control (a) Throughput, (b) contention window size adjustment. 



t = 7000ms, the throughputs begin to converge around 0.20pkt/ms. Figure [9(b)] shows how the 
transmission aggressiveness is adjusted by the online algorithm. 

VI. Conclusion 

We investigated integrated resource allocation for wireless networks which employ random 
network coding as the transport scheme. We used a differential equation based framework that 
models RNC throughput, thereby enabling the analysis of RNC performance in terms of PHY and 
MAC layer parameters. Using this framework, we designed dynamic power control and CSMA 
mean backoff delay control algorithms to improve the performance of RNC. Specifically, we 
used gradient based resource allocation algorithms and evaluated both centralized and online 
versions of them, via the use of differential equation solvers and event driven simulations. Our 
results revealed that such network coding aware resource allocation significantly improves the 
throughput of destination nodes in RNC. We also observed that such integrated power control 
can regain the broadcast advantage. Beyond the use cases of power control and CSMA backoff 
control, the framework and approach presented in this paper can be generally applied to a variety 
of resource allocation problems for RNC. 
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